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ABSTRACT 

We  prove  existence  of  "monotone  trajectories"  for  a class  of  discrete 
and  continuous  systems  sufficiently  general  to  include  problems  of  some 
interest  in  economic  and  biological  theory.  We  prove  existence  of  critical 
points  which  are  Pareto  minima.  We  study  stability  properties  of  Pareto 
minima. 
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MONOTONE  TRAJECTORIES  OF  MULTIVALUED  DYNAMICAL  SYSTEMS 

$ 

Jean-Pierre  Aubtn,  Arrigo  Cellina  and  John  Nohel 

Introduction 

In  "microsystems"  one  or  several  decision  makers  control  the 
evolution  of  the  state  of  a dynamical  system  in  accordance  with  the  rules 
of  optimization  or  game  theory.  We  define  "macrosystems"  to  be 
dynamical  systems  which  are  not  controlled  (in  the  technical  sense  of 
control  theory),  but  for  which  the  state  evolves  by  improving  the  values 
of  several  criteria.  In  our  study  of  macrosystems  we  do  not  look  for 
optimal  trajectories,  but  rather  we  seek  sufficient  conditions  guaranteeing 

4 

the  existence  of  "monotone  trajectories"  for  a class  of  dynamical  systems, 
sufficiently  general  to  include  problems  of  some  interest  in  economic 
and  biological  theory. 

It  is  reasonable  to  describe  the  evolution  of  such  macrosystems  by 
a dynamical  system  of  the  following  type.  Let  U be  a topological  vector 
space,  and  let  X be  a convex,  compact  subset  of  U.  For  i = 1,2,  ...,n 
let  f : X ■»  1R  be  n given  functions,  called  loss  functions;  the 
values  of  the  functions  L should  decrease  as  the  state  of  the  system 
evolves.  Let  S be  a multivalued  mapping  from  X into  U.  We  seek  a 
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function  x : t * x(t)  t X such  that 


(*)  x'(t)  € -S(x(t))  (0  <t  <*;  ' = d/dt) 

where  x(0)  = x°  is  a given  point,  and  such  that 

( **)  each  function  : t — f (x< t))  (i  = l , . . . , n;  0 < t < *>) 

is  nonincreasing.  Relation  (*)  states  that  if  at  time  t the  state  of  the 

system  is  x(t),  then  the  admissible  velocities  x'(t)  are  constrained 

to  lie  in  the  set  -S(x(t))  (this  permits  uncertainty  to  be  included  in  the 

model).  Relations  (**)  require  that  the  evolution  of  the  state  of  the  system 

does  not  increase  ("improves")  the  values  of  the  n loss  functions  f . 

i 

We  summarize  our  results  as  follows.  In  Section  1,  we  establish, 
under  reasonable  assumptions  linking  the  correspondence  S and  the 
loss  functions  f.,  the  existence  of  monotone  trajectories  for  the  discretized 
implicit  system  associated  with  (*),  (**):  find  a sequence  t - x£  t X 
such  that 


(***) 


) (0  < t < + w,  k > 0) 


where  x is  given  and  such  that  (**)  is  satisfied.  We  prove  in  Section  2 
that  the  piecewise  linear  functions  which  interpolate  the  solution  of  the 
discrete  system  (***),  (*1  converge  to  a solution  of  the  system  (*),  (**). 

In  Section  3,  we  show  that  the  same  assumptions  imply  that  for  all  x c X 
there  exists  a critical  point  x of  S (i.e.,  0*-S(x))  such  that 

fj(.x ) ^ f^(  x)  (i  = l,...,n).  In  particular,  this  shows  that  if  x is  a 
Pareto  minimum  (i.  e.,  there  is  no  y « X such  that  f.(y)  < f^x),  i = i , . . . , n, 
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with  My)  < L(x)  for  at  least  one  j),  then  there  exists  a critical 
point  x of  S with  the  property  that  f.(x)  = f.(x)  for  all  i - 1,  . . . ,n. 

We  also  show  that  the  subsets  0 = (x  t X : f.(x)  = f.(x),  i = 1 n J , 

where  x is  a Pareto  minimum,  are  weakly  stable  in  the  following  sense: 

For  any  neighborhood  M of  Q there  exists  a neighborhood  N of  Q 
such  that  for  every  x°  t N there  exists  a trajectory  of  (***),  (*#)  passing 
through  x which  lies  in  M for  all  t > 0.  In  Section  4 we  introduce 
the  concept  of  Lyapunov  function  f for  the  correspondence  S which 
has  the  property  that  f(x*)  does  not  increase  whenever  {x1}^  is  a 
trajectory  of  the  dynamical  system.  We  obtain  stability  properties 
analogous  to  classical  results  for  ordinary  differential  equations.  In  the 
last  section,  we  extend  the  results  of  the  first  section  to  other  discretized 
systems 

t+l  t 

(****)  - — " - c -s(exm  -t  (l  - e)xl)  (o  < e < i ) 

where  x^  is  given  and  where  the  condition  ( **)  must  be  satisfied 
(when  0-0,  we  obtain  the  "explicit"  scheme).  The  assumptions  needed 
for  the  existence  of  a solution  of  (****),  (**)  are  stronger  than  those 
needed  for  the  implicit  scheme  (0  = l). 
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1 . Existence  of  monotone  trajectories  in  the  discrete  case 

We  shell  make  the  following  assumption: 

[ X is  a convex  compact  subset  of  a Hausdorff 

(1)  < 

1 locally  convex  space  U . 

We  consider  a correspondence  S from  X into  U with  nonempty  closed 

convex  images  S(x).  Then  the  Hahn- Banach  theorem  implies  that  these 

images  are  characterized  by  their  support  functions 

# 


(2) 


<r  (S(x);p)  = sup  <p,  y) 
y « S(x) 


where  p ranges  over  the  topological  dual  U of  U.  We  shall  say 

* H 

that  S is  upper  hemi-continuous  if,  for  any  pc  U , x -•  a (S(x);p)  is 
upper  semi-continuous . Any  upper  semi-continuous  correspondence  is 
upper  hemi-continuous,  the  converse  being  true  when  S(x)  is  compact  for 
each  x c X.  We  shall  assume  that 

S is  an  upper  hemi-continuous  correspondence  from 
X into  U with  nonempty  closed  convex  images  Six)  . 


(3) 


We  introduce  n "loss  functions''  f^  which  satisfy: 


(4) 


loss  functions  f.  : X -»  IF  are  convex  and  lower 
i 

somi-continuous  (i  = l,...,n). 


Let  F : X * IF"  be  the  multiloss  operator  defined  by  T(x)  (fj(x),  . . . , f^x)}. 
We  now  need  an  assumption  linking  the  "state  set"  X.  the  correspondence 
S and  the  multiloss  operator  f. 
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Definition  1. 

Wo  shall  say  that  S and  F are  "consistent1'  on  X \i 

C p e U . \ t ERn  and  x e X which  minimizes 

+ 

(5)  \ # 

^ y • \.F(y)  - p,  y‘  on  X,  then  a (S(x);p)  > 0 

Remarks  on  the  consistency  assumption 

Before  stating  the  theorem,  it  is  worthwhile  to  describe  equivalent 

statements  of  (5)  and  give  some  examples. 

Let  be  the  indicator  of  X,  defined  by  ^v(x)  - 0 when  x < X 

and  ev(x)  - +ae  when  x 4 X.  If  g is  a function  from  U into  ]-oot  + »], 

let  dg(x)  = ip  < U*  such  that  g(x)  - g(y)  £ ;p,x  - y for  all  y » U} 

be  the  subdifferential  of  g at  x.  Recall  that  9e^(x)  is  the  normal 

cone  to  X at  x.  If  assumption  (4)  holds,  x c X minimizes 

n , 

y * iX , riy)'  - p,  y)  on  X if  and  only  if  p t 9(  ^ X f . + v^)(x).  Hence, 
if  we  set 


C(X , x)  = 


it  ( S(x);p) 


n 

P«  d(  X f . +vY)(x) 

i = l 1 X 


then  S and  F are  consistent  on  X if  and  only  if 
(7)  :X  < JR".  vx  « X,  C(X,  x)  > 0 . 

o • 

In  particular,  if  the  interior  X of  X is  not  empty  and  if  x e X,  then 


a^fx)  iOj  and 


x « X , C(X,  x)  = 


a (S(x);p)  . 


n 

p « <H  ^ X f )(x) 
i - 1 
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Let  us  remark  also  that  when  the  images  Six)  are  convex  and  compact, 
we  can  write 


(9) 


C(\ , x) 


sup  inf  p,  y'  . 

y t S(x)  n 

P‘  3(  j Vlfj+  vx)(x) 


Assume  lor  instance  that  the  functions 
at  each  point  of  X.  Then  we  can  write 


f 

i 


are  Gateaux  differentiable 


(10)  C(\,x)  = inf  cr#( S(x);q  + V \lDf.(x)) 

qt8^x(x)  i=  1 1 

where  Df.(x)  denotes  the  gradient  of  f.  at  x.  If  the  correspondence 
S is  single-valued,  then 

n 

(11)  C(\ , x)  = inf  (q  + V X Df.(x),S(x)>  . 

qca^x)  i = l 


Now  let  us  consider  the  case  where  K is  a convex  compact  set  of 
controls.  Define 

(12)  S(x)  = A(x)  + B(K) 

where  A is  a single  valued  map  from  X into  U and  where  B is 
linear.  Then 


ii  . 

( C(\,x)  - inf  sup  (q  + ^ \*Df  (x),A(x)  + B(v)' 


(13)  { 


q * 84jx(x)  vi  K i = l 

n n . 

= X X ( Df  (x),  A(x)'  + <x#(K,  B '(  s \lDf.(x))) 
i=l  i=l  1 


+ inf  sup(q,A(x)  + Bv>  . 
q<  3vx(x)  v « K 
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By  a "monotone  trajectory  of  the  discrete  dynamical  system  " we  mean  a 
sequence  of  elements  xC  < X satisfying 


(14) 


t+1 
x 

k 


t 


x 


) 


and 

(IS)  F(xt+1)  < F(xl)  , 

where  x°  is  given,  where  k > 0,  and  where  the  inequalities  (15)  are 
interpreted  in  an  obvious  way.  Our  basic  existence  result  is: 

Theorem  1. 


Let  the  assumptions  (1).  (3),  ( 4)  hold.  If  S and  F are  consistent. 

there  exists  a solution  {x*}  ^ °f  the  discrete  dynamical  system  (14). 

(IS)  for  any  initial  condition  x°  t X. 

In  the  proof  we  will  use  a theorem  of  Ky  Fan  which  states  that 

if  X is  convex  compact,  if  Vy  « X,  x — a(x,  y)  is  lower  semi-continuous 

and  if  Vx  « X,  y -*  a(x,  y)  is  concave,  there  exists  x c X such  that 

sup  a(x,  y)  < sup  a(y,  y). 
y t X y t X 

Proof. 

We  have  to  prove  the  existence  of  xt+*  « X satisfying  (14)  and  (15) 
when  x*  is  given. 

Assume  that  no  solution  exists.  Then,  for  any  x t X,  either 

x xl  - kS(x)  or  F(x)  - F(xt)  is  not  positive.  In  the  first  case,  by 

* 

the  Hahn-Banach  theorem,  there  exists  p « U such  that 
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p.  x P.  x + kn  iS(x);p)  (since  Six)  is  closed  and  convex).  In 
the  second  case,  there  exists  \ • Ir"  such  that  x\,F(x)  - r(xl)>  > 0. 
Let  us  introduce  the  subsets 

(16)  V i'x  < X such  that  p.  xS  > <p,x'>  + ko*(S(x);p)} 

and 

(1~)  V = {x  < X such  that  F(x)  - Fix1)'  > 0}  . 

Since  the  functions  x • ko*(S(x);p)  + 'p,x'  and  x •*  -fv.Tfx)  - F(y)N 

are  upper  semi-continuous  by  assumptions  (3)  and  (4),  these  subsets 

are  open.  The  negation  of  the  conclusion  implies  that  X is  covered  by 

the  open  subsets  V and  V . Since  X is  compact,  we  can  extract 

k p 

a finite  covering:  X U V U V . 

ir  1 Vi  j-1  P) 

Let  ai’  *Vl  < i < k be  a continuous  Partition  of  unity  with  respect 

1 < j < t 

to  this  finite  covering.  Let  a be  the  function  defined  on  X XX  by 

k ( 

(18)  a( x,  y)  - £ « (xK\  ,F(x)  - F(y)>  - V p.(x)(p.,x  - y>  . 

1-1  J = 1 1 1 

Since  the  functions  f.  are  lower  semi-continuous,  we  deduce  that  for 

any  y < X,  the  function  x • a(x,  y)  is  also  lower  semi-continuous. 

The  functions  y * a(x,y)  are  concave  because  the  functions  f are 

convex.  Also,  a(y,  y)  0 for  all  y c X.  Hence  the  assumptions  of  the 

above  Ky  Tan  theorem  are  satisfied,  thus,  there  exists  x € X such  that 

a(x,  y)  < 0 Vy  « X . 
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(19) 


Let  us  set  \ 


k _ t # 

o ix)\  i IR  and  p ^ |3.(x)p  t U . We  can 
i *1  1 ' + j 1 1 1 


write  (ll>)  in  the  form 

(20)  A,  T(x)  - F(y)'>  - \p,  x - y>  < 0 Vy  < X . 

Therefore,  by  the  consistency  assumption  of  S and  F on  X, 

(21)  o *(S(x);p)  > 0 . 

We  obtain  a contradiction  by  showing  that  a(x,  xl)  > 0.  Indeed,  a.(x)  > 0 

for  at  least  one  index  i or  (Mx)  > 0 for  at  least  ona  index  j.  If 

a .( x)  > 0.  then  x < V and  thus,  (v  , F(x)  - F(xt)  > 0.  Hence 
l \ . i 

k 1 _ 

/\.  F(x)  - HxV'  : ^ a (xl/\  , F(x)  - F(xl)>  > 0.  If  (3  (x)  > 0,  then 

i-1  1 1 ‘ 

— j ~ t # — j 

x t V and  this  implies  that  -/p  , x - x ) > ka  (S(x);p  ).  Therefore  using 

1 t _ _ t 

(17)  and  ^ p.(x)  = 1,  we  obtain  -'p,  x-x)>k  P . (x)a  (S(x),pJ) 

j=l  J J=1  J 

> kn  *(S(x);p  > 0.  Hence  a(x,  x1)  = A,  F(x)  - F(xV/  - ( p.  x - x^  >0.  i 

Remarks  on  the  existence  of  trajectories 

In  the  case  where  F = 0,  the  consistency  assumption  becomes 

the  so-called  ''Ky  Fan  boundary  condition".  The  Browder  - Ky  Fan  theorem 

states  that  this  assumption  and  assumptions  (1)  and  (3)  imply  the  existence 

of  a solution  x t X of  the  multivalued  equation  0 c -S(x)  (see  Browder, 

Ky-Fan,  Cornet  fl)  and  f 2 ) for  instance). 


Theorem  1 states  that  under  the  same  assumptions,  there  exists  a 
solution  {x1;^  ,q  discrete  dynamical  system  (14).  ■ 


Generali  zatt  o n 


(22) 


Let  us  consider  now  n functions  <p  : X x X * ER  satisfying 

i)  Vy  < X,  x • c.(x,y)  is  lower  semi-continuous 

ii)  vx  t X,  y ♦ <p.(x,y)  is  concave 

Hi)  sup  v>(y,  y)  < 0 . 
y € X 


We  set 


Definition  2. 


<l>(x,  y)  = (</>.(x,y)}  . 


We  shall  sav  that  S and  <p  are  "consistent"  if  fp  « U , V\  « IR+, 
for  any  x c X satisfying 
(23) 


sup  (<\,<t>(x,  y)>  - <p,  x - y>)  < 0 
y « X 


then  o (S(x);p)  > 0. 
Theorem  1 bis. 


Let  us  assume  that  properties  fl).  (3)  and  (22)  hold  and  that  S and 
<}>  are  consistent.  For  any  initial  condition  x°  < X,  there  exists  a 
solution  of  the  dynamical  system  (14)  satisfying 


(24) 

Proof 


ill  k 

Vi  = 1,  ....  n,  v,(xl  ;x')  <0  for  all  t > 0 . 


The  proof  is  exactly  the  same  than  the  proof  of  Theorem  1 where 
we  replace  F(x)  - F(y)  by  <J>(x,  y).  • 
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Example . 


Let  us  consider  n loss  functions  f.  : U * +00  I such  that 

(25)  Vi  - 1 , . . • , n , f . is  convex,  finite  and  continuous  on  X . 

Then  f is  differentiable  from  the  right  and  the  function  - defined  by 
i 

<p.(x,  y)  = -Df.(x)(y  - x) 

f.(x  + 0z)  - f;(x) 

satisfies  properties  (22)  [ where  Df  (x)(z)  = inf  ~ is  the 

1 e>o 

derivative  from  the  right,  which  is  continuous  with  respect  to  x and  z]  . 
Corollary  (of  Theorem  1 bis). 

Let  us  assume  that  properties  (1).  ( 3)  and  (2  5)  hold. Suppose  also 

that  S and  F are  consistent  on  X.  For  each  initial  condition  x t X, 
there  exists  a solution  {x  of  the  discrete  system  (14)  satisfying 

(26)  Vi  1,  . . . ,n,  {.(x1)  - f.(xt+1)  > Df.lx1  *)(x  - x ) > 0 . 
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-*.1  ?L(‘n-Ct-'  pf  monotone  trajectories  m the  continuous  case 
We  shall  deduce  from  Theorem  1 of  Section  1 the  existence  of 
monotone  trajectories  of  d multivalued  dynamical  system  in  the  continuous 
case.  A trajectory  is  a continuous  function  x ( C(0,T;1R,),  whose 
derivative  tin  the  sense  of  distributions)  belongs  to  LJ(0.  T;IR#).  satisfying 
i)  ’ ( [ 0,  T|,  x(t)  « X and  x(0)  x , where  x^*  < X is  given 


ID 


ii)  for  almost  all  t « [ 0.  T).  ~ (t)  < -S(xlt))  ; 


in  addition,  the  traiectorv  x is  monotone  if 
1 ^ f°r  3ll  i 1,  ....  n,  t * f.(x(t))  is  decreasing, 

where  f are  given  loss  functions. 

Theorem  2. 

Let  us  assume  that 

( 3)  X is  a convex  compact  subset  of  IR* 

that 

S is  an  upper  semi-continuous  correspondence  from  X into 

<41  ■ 

Ik  with  nonempty  convex  compact  images 

and  that 

1 fAe  n functions  f.  : X - IR  are  convex  and  continuous  . 

If  the  correspondence  S and  the  multiloss  operator  T are  consistent 
2H  X,  - . . < fcr  i.iy  T > 0 there  exists  a monotone  trajectory  of  the 
system  II),  (2)  on  [ 0,  T). 
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Proof. 


Let  N be  a positive  integer  Consider  the  discrete  dynamical 


system  1-4).  1-^1  of  Section  1 with  k With  any  monotone  trajectory 

{tC  : q of  this  discrete  system  we  associate  the  piecewise-linear 

function  x,  (t)  .vhich  interpolates  the  values  x*  at  the  nodes  tk(l  < t < N): 

K — — 

we  have 

► i t+1  _ t 

16)  x^itk)  x and  ^ x^t)  = £ — ~ if  T * )kt,(k  + l)t[  . 

Since  X is  compact  and  S is  upper  semi-continuous,  S(X)  = '-.J  S(x) 

x < X 

is  compact.  Hence,  there  exists  a constant  a > 0,  independent  of  k 
and  T.  such  that 

(~)  s up  x (t)||  £a  and  sup  ||-^  x ,(T);  <a  for  all  k . 

I 0,  T]  re  [ 0,  T ] 

This  implies  that  the  functions  x^  are  uniformly  Lipschitzian  and  thus, 
remain  in  a bounded  equicontinuous  subset  of  C(0,  T;JR#)  which  is  rela- 
tively compact  according  to  Ascoli's  theorem.  Hence  we  can  extract  a 
subsequence  l again  denoted  x^)  which  converges  uniformly  to  a function 
x «.  C(0,  T;IR#). 

Since  for  all  t * [ 0,  Tj.  we  have 


(8)  f x (ft)dff  = x (T)  - x°  converges  to  x(t)  - x^  , 

q U l K 


we  deduce  that  the  sequence  ~~  x^  converges  weakly  in  l\o,  T;JR#)  to 
the  derivative  lin  the  sense  of  distributions)  of  x,  which  belongs  to 
L^O.  T;u/j. 


Since  the  correspondence  S is  upper  semi-continuous,  wo  cun 
associate  to  any  bail  B(c)  oi  radius  e > 0 a ball  B(  "))  of  radius  rj 
such  that 


(9) 


S(y)  S(x(t))  + B(e)  when  y t x(t)  + B(  rj) 


On  the  other  hand,  since  x^  lies  in  an  equicontinuous  set  and  converges 

uniformly  to  x,  there  exist  a > 0 and  kQ  > 0 such  that,  for  any 

k < kQ  and  |T-tj<or,  we  have  l!x  (t)  - x(t)  li  < n.  Therefore 

(10)  S(x,  (t))  S(x(t))  + B(e)  when  k < k.  and  |t  - t|  < a . 

Since  the  sequence  ^ x^  converges  weakly  to  g^x  in  L^O,  TjlR*), 

there  exists  some  sequence  of  convex  combinations  u V ak  — x 

4 k~k  ' dt  k 

d . . 0 

which  converges  strongly  to  — x in  L (0,  T;IR  ).  Let  r«(o,T|.  Since 


* k . t V1  Lk 

y k A.  , > . V k X - X 

-„'dt  ' k 


where  t - t,  k i < a 
k - 


V1  V 

X - x 

and  since  - € -Sfx^t^k)),  for  some  integer  t^  we  deduce 

from  (10)  that  for  any  / > k^, 


* u 0,'S(x  (t  k))  C V ak[S(x(T))  4 B(e)|  ~ Stx(r))  + B(e) 
k - k,  K •'-i'  ' 


k - k 


for  the  latter  subset  is  convex.  It  is  also  closed.  Therefore,  since  some 

subsequence  of  p converges  almost  everywhere  to  ~ x.  we  deduce 
1 dt 

dx 

that  ” dT(t)  belongs  to  s(x([))  + B(e)  for  almost  all  t.  Thus,  by 

d x 

letting  e converge  to  0.  we  deduce  that  — (t)  * -S(x|t))  for  almost  all  t. 
It  remains  to  prove  that  the  functions  t * f.(x(t)l  are  decreasing. 
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Let  t < s.  Since  x^.  lies  in  an  equicontinuous  subset,  we 
can  associate  with  any  n a number  o such  that  'ix^(T)  ” xft),  1 n 
and  i|x^(a)  - x(s)  II  < n when  |'t  - t j £ a,  v - s ; < a and  k £ k^ 

Since  the  functions  f.  are  continuous,  we  can  associate  with  any  e > 0 
a number  n such  that  f.(x(t))  < f.(y)  + ^ and  f,(z)  £ f.l’x(s))  + ^ 
when  SJx(t)  - y I!  < n and  i!x(s)  - z |j  < q.  Therefore,  for  any  e > 0, 
we  can  find  kQ  such  that,  for  any  k < kQ,  there  exist  integers  t^ 
and  s^  satisfying  t < t^k  < s^k  < s and  it  - t^k  | < a,  js  - s^k  ! < a. 
Since  x.  (s.  k)  < x,  (t.  k),  we  deduce  that  f.(x(s))  < f.(x(t))  + e for  all  i. 

By  letting  e go  td  0,  we  deduce  that  f.(x(s))  < f.(x(t)).  ■ 

Remark. 

We  refer  to  papers  by  Antosiewicz-Cellina,  Brezis,  Castaing-Valadier, 
Clarke,  Henry  [1],  [2],  Valadier,  for  the  study  of  multivalued  ordinary 
differential  equations  (but  without  the  subsidiary  condition  (2)).  ■ 

Generalization. 

In  Theorem  2 (continuous  case),  we  can  drop  the  convexity  assumptions, 
since  it  is  not  necessary  to  approximate  the  would-be  solution  by  exacr 
solutions  of  the  discrete  scheme.  We  can  extend  the  Nagumo  theorem 
(see  Nagumo)  to  the  case  of  monotone  trajectories  of  multivalued  differential 

equations,  by  adapting  the  proof  of  Crandall  [ see  Crandall) . We  obtain 

* 

Theorem  2 bi s . 

Let  us  assume  that 

(3  bis)  X is  a compact  subset  of  IR^ 
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S is  an  upper  semi-continuous  correspondence  from  X 

/ 

into  IR  with  nonempty  convex  compact  images 


(5  bis)  the  multiloss  operator  F is  continuous  from  X into  IR 
and  that  S and  F are  consistent  on  X in  the  sense  that 

(11)  x t X,  1 im  inf  r o uniformly  over  X 

k -0  + 

where  we  set 

(12)  A(x,  k)  inf  inf  II x - ku  - v I1 . 

u i S(x)  F(v) < F(x) 
ve  X 

Then,  tor  any  T > 0,  there  exists  a monotone  trajectory  of  the  system 
(1),  (2)  on  [0,  T). 


Proof. 

Indeed,  if  we  set  t](k)  = sup  ^ equation  (12)  allows  us 

^ v ^ 

X € X 

to  construct  an  approximate  solution  of  the  explicit  discrete  scheme, 
by  associating  with  any  x*  € X an  element  xt+*  c X satisfying 
F(xt+*)  < F(xl)  and  an  element  yt  * S(xl)  such  that 


t+l  _ t 

- — - — — + y < r|(k)  for  any  t , 


i.e.,  such  that,  for  any  t, 


t+l  t 

X ' « -S(xl)  + n(k)B 


ii)  F(xt+i)  < F(xl) 


where  B is  the  unit  ball  of  IRn.  The  convergence  proof  of  Theorem  2 
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shows  that  the  ptecewise-linoar  function  which  interpolates  the  solution 
ot  ili)  converges  to  a monotone  trajectory  of  the  system  (1),  (2). 

Remark . 

We  san  prove  that  (11)  follows  from  the  following  property 
S is  continuous  and 

x t X,  p < IR*.  for  any  v i X which  minimizes 

y ♦ x-p-y!i  under  the  constraint  F(y)  < F(x). 

then  sup  (x  - p - v,  z)  > 0 
z « S(x) 

by  adapting  the  proof  of  Lemma  1 of  Crandall.  ■ 


5 • Stability  of  Pareto  minima 

The  solutions  x of  the  multivalued  equation  0 « S(x)  are  called 
the  "critical  points"  of  the  correspondence  S (or  "equilibria"  of  S). 

If  x is  such  a critical  point,  the  constant  trajectories  {x,  x,  . . . , x,  . . . } 
are  obviously  solutions  of  the  dynamical  systems  (14)  of  Section  1 and 

(1)  of  Section  L . 

Let  us  recall  that  x e X is  called  a "Pareto  minimum"  of  F if 
there  is  no  y c X such  that  F(y)  < F(x)  and  F(y)  * F(x).  In  other 
words,  if  we  set  ~ 

P (x)  = (y  c X such  that  F(y)<F(x)} 
we  see  that  x is  a Pareto  minimum  if  and  only  if 

(2)  p"(x)  = F_1F(x)  . 

There  exist  points  which  are  both  critical  points  and  Pareto  minima  under 
the  assumptions  of  Theorem  1 of  Section  1. 

Theorem  3. 

Let-Us  suppQse  that  assumptions  of  Theorem  1 of  Section  1 hold.  For 
x ‘ X,  the  subset  P (x)  contains  a critical  point  x of  S-  In 
particular, — d x * X ig  any  Pareto  minimum  of  F,  there  exists  a critical 
Point  x Qf  S such  that  F(x)  = F(x). 

Proof. 

The  proof  is  analogous  to  that  of  Theorem  1 of  Section  1.  Assume 
that  the  theorem  is  false.  Then,  for  any  x t X,  either  there  exists 
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\ t IRn  such  that  (V,  F(x)  - Fix)'.  > 0 or  0 / Six),  and  thus,  there 
* # 

exists  p « U such  that  0 > a (S(x);p).  Hence  X can  be  covered 

by  the  union  of  the  subsets  V (x  « X such  that  Fix)  - F<x)'  > 0 

\ 

M 

and  V fx  t X such  that  0 > a (S(x);p)},  which  are  open  due  to  assurr.p- 
P 

tions  (3)  and  (4)  of  Section  1.  Since  X is  compact,  we  can  extract  a finite 
covorinq  ar.u  choose  a continuous  partition  of  unity  subordinate  to  this 
covering. 

We  introduce  the  function  a defined  by  (18)  of  Section  1.  The 

assumptions  of  the  Ky  Fan  theorem  are  satisfied:  there  exists  x « X 

such  that  sup  a(x,y)<0,  i.e..  such  that 

y * x 


(3) 


F(x ) - F(y)>  - <p,  x - y)  < 0 Yy  « X . 


The  consistency  assumption  implies  that  a (S(x);p)>0.  Now.  if  (3,(x)>0 

= # = j 

for  at  least  one  index  j,  then  x t V and  thus,  o iS(x);pJ)  < 0.  Hence 

P; 


l 


J 


it  (S(x),p)<  Yj  P ( x )<*  (S(x);p))<0.  This  is  impossible.  Hence 
j = l J 

p.(x)  = 0 for  all  indices  j.  Therefore,  o.(x)  > 0 for  at  least  one 

index  i:  then  x « and  thus,  ^V.F(x)  - F(x)‘  > 0.  Since  \ * 0 

_ i _ _ 

and  p - 0 in  this  case,  we  deduce  that  ^Ffx)  - F(x)'  > 0 and.  from 

(3),  that  '\,F(x)  - F(x)N  <0.  Again,  we  obtain  a contradiction. 

Hence  p (x|  contains  a critical  point  of  S. 

Furthermore,  if  x is  a Pareto  minimum,  p (x)  = F Vlx)  contains 
a critical  point  x . • 

Let  us  consider  the  discrete  and  continuous  dynamical  systems 
(14)  of  Section  1 and  (1)  of  Section  l. 
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Dcnnition  3 


Wo  shall  say  that  a subset  0 is  "weakly  stable1  for  the  discrete 
system  14)  of  Section  1 (resp.  for  the  continuous  system  (1)  of  Section  2) 
it  for  any  neighborhood  M of  Q,  there  exists  a neighborhood  N of 
Q such  that,  for  any  initial  value  x°  « N.  there  exists  a trajectory 
starting  at  x°  of  the  discrete  system  (14)  of  Section  1 (resp.  of  the 
continuous  system  ( 1 ) of  Section  2)  lying  tn  M. 

Theorem  3. 

Let  us  suppose  that  assumptions  of  Theorem  1 of  Section  1 (resp.  of 
Theorem  l of  Section  2.)  are  satisfied.  Let  us  assume  also  that 
(4)  the  functions  f.  are  continuous  on  the  set  of  Pareto  minima  . 

Then,  for  any  Pareto  minimum  x « X,  the  subsets  t5  (x)  are  weakly 
stable  for  the  discrete  system  (resp.  the  continuous  system). 

Proof . 

The  proof  is  analogous  to  the  proof  of  Theorem  3-8  of  Maschler-Peleg. 

Let  M be  an  open  neighborhood  of  P (x).  Hence  K = (x  i X such  that 

x ^ M}  is  compact.  Tor  any  y * K,  there  exists  at  least  one  index  i 

such  that  f.(y)  > f,(x)  + e(y)  where  e(y)  > 0.  Since  the  function  f.  is 

lower  semi-continuous,  the  subsets  B(y)  {y  i X such  that 

f.(y)  > fix)  4 e f y) } are  open;  they  form  a covering  of  K,  from  which 
1 1 m 

we  can  extract  a finite  covering  K B(y  ). 

k -1 

Let  e = min  c(yR)  >0  and  N - {y  * X such  that  f^y)  < fj(x)  + e 

k = l, . . . , m 

i 1.  . . ,n}.  Hence  N M.  Wo  also  know  that  if  wo  choose 
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for  all 


^ 0 (j 

any  x i N.  then  fix)  t x»  - e for  all  1.  Lot  us  consider  the 

i 1 

case  of  a discrete  dynamical  system:  there  exists  a solution  {x1}^ 

such  that,  i 1 n.  f.tx1)  < f.(x°)  < f.(x)  + e for  all  t,  i.e..  such 

i ~ i i 

thdt  x « N M for  all  t.  Now.  since  the  functions  f.  are  continuous 
on  the  set  of  Pareto  minima,  the  set  N is  a neighborhood  of  tJ  (x)  = F^F(x). 
Hence  9 (x)  is  weakly  stable.  In  the  case  of  a continuous  system, 

Theorem  2 ie  plies  the  existence  of  a trajectory  such  that 
f . ( x( t) ) < f ,x°)  < f (x)  + e for  all  i.  We  deduce  in  the  same  way  that 
P (x)  is  weakly  stable.  • 


4.  Lyapunov  functions 

Let  us  consider  a function  f : U * J-«3,  + an)  satisfying 

(])  f is  convex  and  finite  and  continuous  on  X . 

It  has  a derivative  Df(x)(z)  from  the  right  at  each  point  x « X.  Let  us  set 

(2)  B (x)  = inf  Df(x)( z)  . 

zf  S(x) 

Definition  4 . 

We  shall  say  that  f is  a Lyapunov  function  for  the  correspondence 


S if  it  satisfies  (1)  and 


Vx  < X,  Bj.(x)  > 0 


With  this  definition  we  obtain  the  following  result. 

Proposition  1 . 

Let  {x^t>0  be  any  solution  of  the  discrete  dynamical  system  114) 
of  Section  1.  Let  f be  a Lyapunov  function  for  S.  Then,  for  all  t 


(4)  f(xt+1)  - f(x*)  < -kBf(xt+1)  < 0 . 


Proof. 


Since  f is  convex,  we  have 


j (f(xt+1)  - f(x1))  < Df(xHl)(-  


t+1  1 

y — X t 4- 1 

Since  - < S(x  ),  inequalities  (2)  and  (5)  imply 


fix' +i)  - f(xC)  < -kBf(xl 4l) 


Hence  (4)  follows  from  (6)  and  (3). 
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Remark. 


If  f is  a Lyapunov  function  for  S,  then  the  sequences  t - fix  ) 

decrease  for  any  trajectory  of  the  discrete  dynamical  system  M4)  of 

Section  1 If  f, ,...,f  are  n Lyapunov  functions  for  S.  then  the 
1 n 

subsets  p (x)  are  invariant;  if  x is  a Pareto  minimum,  the  subsets  P (x)  arc 

stable  in  the  sense  that  for  any  neighborhood  M of  P (x),  there  exists  a 

0 

neighborhood  N of  P (x)  such  that,  for  any  initial  value  x t N,  all 
the  trajectories  starting  at  x°  remain  in  M (the  proof  is  analogous 
to  that  of  Theorem  3).  For  related  results,  see  the  book  of  Brauer  and 
Nohel,  the  papers  of  Champsaur,  Champsaur-Dreze-Henry,  Lassalle, 
Maschler-Peleg,  Uzawa,  Yoshizawa,  etc. 

Remark . 

We  can  extend  these  results  by  assuming  only  that  f is  locally 
Liuschitz  and  by  replacing  the  derivative  from  the  right  by  the  generalized 
directional  derivative 


Df(x)(z)  - lim  sup 
0-0  + 


introduced  by  F.  H.  Clarke. 


Remark. 


Since  the  inequality 


Z ^Bf  l*)  * B 

i = 1 i 


i = 1 n 

n v1  i 

obviously  holds  when  \ c IR^,  then  the  functions  \ f are  Lyapunov 

1 = 1 

functions  for  S if  (and  only  if)  the  functions  f.  are  Lyapunov  functions. 


Remark. 

We  can  also  use  Lyapunov  functions  to  study  asymptotic  stability. 
Let  t . . ■ • . f be  n Lyapunov  functions.  Let  us  assume  that 
X is  compact  an.;  that 


whenever  x is  not  a Pareto  minimum,  there  exist  \ c IR  , 

+’ 


\ * 0 and  e > 0 such  that  B 


V v*,. 


(y)  > e whenever 


f (y)  > f (x)  for  all  i = 1 n . 


Then,  for  any  solution  {x1}  of  the  discrete  dynamical  system  (14)  of 
Section  1 cluster  points  of  {x1}  are  Pareto  minima. 

Proof. 

Since  the  sequences  L(x  ) are  bounded  from  below  and  decreasing, 

they  converge  to  scalars  c..  Since  X is  compact,  subsequences  of 

x*  converge  to  elements  x satisfying  f (x)  = inf  fix*). 

1 t>0  1 

Let  us  assume  that  x is  not  a Pareto  minimum:  Assumption  (9) 

implies  that  there  exist  X e lRn,  \ 4 0 and  e > 0 such  that  B (x1)  > e 

+ n . 

i 1 1 

for  all  t.  By  Proposition  1,  we  obtain: 

n n 

no)  ' “ X X U*1)  < -e  . 

i - 1 i = 1 1 

By  adding  these  inequalities  from  t 0 to  t s - 1.  we  deduce  that 
n-  i n . Q 

^ \‘f.(xS)  < X f (x  ) - cs,  which  converges  to  -00  when  s — *>. 

1-1  1 i 1 1 

This  is  impossible.  ■ 


Rem  nr  k . 


Let  us  re.  ill  that  it  t ts  convex  and  continuous,  its  subdifferential 

<3 it x)  lS  : et  empty  and  that  Df(x)lz)  sup  <p,  z)  . Hence  we  can  write 

p i af(  x) 

til)  B x)  inf  sup  p.  z'  sup  inf  'p,z'' 

z»  Six)  pi  rfftx)  pc  9f(x)  zc  S(x) 

tie  nee  S ) is  closed  and  convex  and  9f(x)  is  compact  and  convex).  It 

is  wortr.-.vhile  to  compare  this  formula  with  formula  (9)  of  Section  1. 

Examples  of  Lyapunov  functions. 

Let  U be  a Hilbert  space. 

Let  us  consider  the  correspondence  S = 9g  where  g is  a 
continuous  convex  function  defined  on  an  open  convex  subset.  Then  the 
functions  f g and  f (y ) = "•  i|y  - x I! 2 where  x minimizes  g 

1 C.  L. 

are  Lyapunov  functions  of  S ■ 9g . 

Indeed,  let  zc  9g(x).  Since  Dg(x)(z)  = sup  <p,  z\  we  deduce 

p « 9g(x) 

that  z < Dgix)(z).  Hence 

B (x)  > inf  .1  z !!  2 >.  0 
z c 9g(  x) 

and  g is  a Lyapunov  function  for  9g. 

Let  us  consider  now  the  case  where  f(y)  = ~ !J y - x || 2 . Since 

Df(y)(z)  xy  - x,  z . we  deduce  that 

B ix)-  inf  'x  - x,  z'  - - sup  'x  - x,  z)  = -Dg(x)(x  - x)  . 

z c 9g(x)  z c 9g(x) 

Since  g is  convex,  we  know  that 

DglxMx  - x)  < g(x)  - g(x)  . 
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Hence 


r 


Bf(x)  > g(x)  - g(x)  > 0 , 

and  f is  u Lyapunov  function  for  ag  when  glx)  - inf  gfx). 

x c X 

More  generally,  let  us  assume  that  x satisfies 

I ] <?)  a *(S(x).  x - x)  < 0 for  all  x t X , 

hence  the  function  f defined  by  f( y)  = j |l  y - x li 1 is  a Lyapunov 
function  for  S.  This  kind  of  condition  is  used  in  mathematical  economics 
(see  Arrow-Hahn  for  instance).  ■ 

The  problem  arises  whether  there  exists  a solution  x of  (12).  Such 
a solution  exists,  not  only  in  the  case  of  S dg,  but  in  the  more 
general  case  when,  for  example.  S is  a monotone  correspondence: 

Let  S be  a monotone  correspondence  and  x € X a solution  of 
the  variational  inequalities  for  S in  the  sense  that 

3 p < S(x)  such  that  ( p, x - y'  < 0 YycX. 

Then  the  function  f(y)  - -j  II y - x II  is  a Lyapunov  function  for  S. 

Indeed,  since  S is  monotone,  we  obtain  for  any  q * S(y), 

'q,  x - y'  < ( p,  x - y)  < 0.  Hence  tr  ^(S(y),  x - y)  < 0 for  ail  y t X. 
Recall  that  a solution  x of  the  variational  inequalities  exist  when  X 
is  convex  compact  and  S is  a monotone  correspondence  with  nonempty 
convex  compact  values  whoso  restriction  to  all  finite  dimensional  spaces 
is  upper  hemi-continuous  (se*~  nre?  for  instance).  ■ 


Proposition  1 can  bo  extended  to  the  case  of  a continuous  dynamical 
system  (1)  of  Section  2.  for  that  purpose,  we  need 
Lemma  1. 

Let  f be  a function  satisfying  (1).  Let  x be  a differentiable 
tunction  from  | 0.  T|  into  X.  Then  the  Dim  deri  /ative  |~J  [f(x(t))J 


lim  sup 
ii  * 0 1 


x(t  * h) I - fix( 


satisfies  for  almost  all  t the  inequality 


(^)  f[x(t)]  + Df(x(t))(-  ^ ) < 0 . 


Proof. 


Indeed,  the  convexity  of  f implies 


Df(x( t + h)l(  *<’»  ' h>)  < 


Since  Df(y)(z)  = inf 

e « [ o. 1 1 

function  (y.  z,  0}  - ^ +~ 


is  the  infimmum  of  the  continuous 


when  0 ranges  over  the  compact 


set  ( 0,1  ) , we  deduce  that  {y.z}  — Df(y)(z)  is  continuous.  Hence  we 
obtain  (13)  by  letting  h converge  to  0 in  (14).  ■ 

Proposition  2. 


Let  x(  • ) be  any  solution 


mtinuou; 


?m  (1)  of 


Section  2.  Let  f be  a Lyapunov  function  for  S . Then,  for  almost  all  t 


( dt  * - _bf(x(t^  - 0 • 


Proof. 


Since  - ~ (t)  « S(x(t))  for  almost  all  t,  we  deduce  (is)  from 


(2),  (3)  and  (13). 


=>.  Other  discrete  dynamical  system? 

The  discrete  dynamical  system  1 1 4 ) of  Section  1 is  a particular 
example  of  a family  of  discrete  dynamical  systems. 

ll)  - xl  t -k S(0xt  * + (1  - Q)xl) 

where  0<  [ 0.  1 | . For  0 1,  we  obtain  the  "implicit  " d iscrete  system 

(1-1)  of  Section  1.  When  0 = 0,  it  is  the  so-called  explicit  dynamical 


system . 


xl  ^ - x^  * -kSfx*)  . 


For  0 - 1/2.  we  obtain  the  Crank-Nichol son  system  In  order  to  prove 
the  existence  of  monotone  trajectories  of  the  system  (1),  we  need  a 
consistency  assumption  between  S and  F which  depends  upon  0: 
Definition  5. 

We  shall  say  that  S and  F are  "e-consistent"  on  X if  “p»  U , 

\ < IRn,  for  any  x i X which  minimizes  y * Tfy)'  - /p,  yN  , we  have 

(3)  ''x,  F ( x ) ' -'p,x)<  inf  l 'X,  F(y)>  - (p,yN  + k«v#(S(ex  + (1  - G)y;p)]  . 

y « X 


Remark 


It  is  clear  that  the  0-consistency  implies  the  consistency 


Theorem  4. 


Let  us  assume  that  properties  (1).  ( 3)  and  (4) 


S and  F .ire  o-consistent.  there  exists  a solution  fx  } of  the  discrete 
dynamical  system  (1)  satisfying 

(4)  f(xt+1)  < F(xl)  for  all  t>° 


for  any  ini 


tial  condition  x < X. 


■-iVtS/SSSfaVL'  ■ 


The  proof  is  analogous  to  the  proof  of  Theorem  1 and  so  we  only 
sketch  it.  Assume  that  no  solution  exists.  Then  for  any  x • X.  either. 


there  exists  p * U such  that  x * ' y * X such  that 

p.  xL  » > p.  y‘  - ko  *i  Si  Oy  * «1  - OjxY.p)  \ or  there  exists  X c k"  such 
that  xi  : {y  t X such  that  X.  F(y)  - HxV  ^0}  or  both.  Since  X 

is  compact,  it  can  be  covered  by  a finite  union  of  these  open  subsets 


V 

i 


k)  and  V (j  1 /).  We  introduce  a continuous 

P1 


partition  of  unity  !u  , (3  . , subordinate  to  this  covering  and  the 

1 J l 1 , • • • , K 


i i. 


function  a ae fined  by 


i 5) 


k * 

arx.y)  X a.(x)'X  , T(x)  - F(y)>  - 1 P.W'P.-x-y'  • 
ui  1 1 i--i  1 


The  assumptions  of  the  Ky  Tan  theorem  are  satisfied:  hence  there  exists 

k _ * _ 

x such  that  sup  a<x.  y)  < 0.  If  we  set  X = ^ a (x)X  and  p - 2j  YX^i’ 

y « x i =1  1 i--i  1 ’ 

we  have 

(6)  x,  T(x)  - F(y)>  + 'p,  x - y'  < Otfy  « X . 

The  0-consistency  implies  that  (3)  holds  We  shall  contradict  it.  Indeed, 
there  exists  i such  that  o.(x)  > 0 or  there  exists  j such  that 


a (x)  >0.  If  u lx)  > 0.  then  x < V and  'X  ,F(x)  - F(x  )N  > 0.  Hence 
) 1 i , „ . _ 

V.  Fix)'  >/X,F(x1)'  . If  (J  (x)  > 0,  then  x«V  and  p,x  > d. 

* ko  ”l S< Ox  - 11  - 0)xS;pJ)-  Hence  - P,x'  > kn*(S(0x  + (I  - 0)x  );p)  - p,x  . 


P , x 


Therefore, 


P 


- Z'i  - 


MBMWMt 


FlxV  - ' p,  x"  • k'i  (SfOx  t (1  - GlxSip)  < 

A,  Fix)'  - p.x'  inf|  '\.Hy)'  -'p.  y ) . 
y t X 


Remark . 

In  the  case  where  G - 0,  we  obtain  the  following  result. 
Proposition  3. 

Let  us  assume  that  (1),  (3)  and  (4)  of  Section  1 hold.  For  any  t > 0, 
, . t+1 

there  exists  a solution  x of. 

(8)  xt  + * - xl  < -kS(xl)  and  F(xt+S  < Fix1) 


if  and  only  if 


v\  « IR",  Y p « U*,  inf  (a,F(y)>  - (p,  y)) 


< <\,  F(x1))  - <p,  xH  + ko  #(S(xt);p) 


Proof. 


Indeed,  if  x*  ^ satisfies  (8),  we  deduce  that  <X,  T(xl  S'  < \.  F(xV 

t+1  t # t n * 

and  that  - ' p,  x ) < ~ ' P,  x v + kir  (S(x  ); p)  for  any  V « and  p < U . 

Hence  (8)  implies  (9). 

Conversely,  the  proof  of  Theorem  4 with  0 = 0 shows  that  the  non- 
existence of  a solution  of  xt+*  of  (1)  implies  (7)  with  0 = 0,  which 
contradicts  (9).  ■ 

Remark. 

In  the  case  where  0 = 0,  we  do  not  need  to  assume  that  S is 
upper  hemi-continuous  in  Proposition  3 (since  the  subsets 
Vp  {y  t X such  that  < p,  x X > (p,  y>  + ko  (S(x  );p)]  are  always  open). 

The  stability  results  of  the  implicit  discrete  system  remain  true  for 
the  other  discrete  systems.  ■ 


■t  NR 
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